منابع مشابه
The Deterministic Information Bottleneck
Lossy compression and clustering fundamentally involve a decision about which features are relevant and which are not. The information bottleneck method (IB) by Tishby, Pereira, and Bialek ( 1999 ) formalized this notion as an information-theoretic optimization problem and proposed an optimal trade-off between throwing away as many bits as possible and selectively keeping those that are most im...
متن کاملThe information bottleneck method
We define the relevant information in a signal x ∈ X as being the information that this signal provides about another signal y ∈ Y . Examples include the information that face images provide about the names of the people portrayed, or the information that speech sounds provide about the words spoken. Understanding the signal x requires more than just predicting y, it also requires specifying wh...
متن کاملThe Information Bottleneck EM Algorithm
Learning with hidden variables is a central challenge in probabilistic graphical models that has important implications for many real-life problems. The classical approach is using the Expectation Maximization (EM) algorithm. This algorithm, however, can get trapped in local maxima. In this paper we explore a new approach that is based on the Information Bottleneck principle. In this approach, ...
متن کاملThe Information Bottleneck Method[1]
A fundamental problem in formalizing our intuitive ideas about information is to provide a quantitative notion of “meaningful” or “relevant” information. It is argued in this paper that information theory, in particular lossy source compression, provides a natural quantitative approach to the question of “relevant information.” Specifically, the authors formulate a variational principle for the...
متن کاملThe Deterministic Bottleneck Model with Non-Atomistic Traffic
This paper investigates the conditions under which dominant airlines internalize self-imposed delays in a deterministic bottleneck model of airport pricing, complementing the similar analysis of Brueckner and Van Dender (BVD, 2008) for the standard congestion-pricing model. A unified model of bottleneck tolling includes untolled, uniform-, coarse-, multi-step-, and continuous-toll equilibria as...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Neural Computation
سال: 2017
ISSN: 0899-7667,1530-888X
DOI: 10.1162/neco_a_00961